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[57] ABSTRACT 

The present invention relates to a method and device for the 
detenriination of restricted colors by a means where, for 
example, image data displayed by means of approximately 
16,000,000 colors is displayed in terms of a restricted 
number of colors. For example, in the case of 256 colors, an 
image is displayed in more natural colors. Furthermore, the 
present invention relates to a method and a device for the 
prevention of the generation of pseudo color contouring by 
means of specifying, in advance, portions in which the color 
variation is loose from the periodicity of the values appear- 
ing in the subordinate bits of each picture element at the time 
of the specification of display colors, and allocating a large 
number of display colors to portions having loose color 
variation. In addition, the present invention relates to a 
method and device which, by means of disposing each 
picture element of the image data in a uniform color space 
and conducting a discriminant analysis with respect to the 
distribution of the picture elements in this color space, 
determines ranking numbers with respect to the coordinate 
axes of the chromaticity component of the uniform color 
space and ranking numbers with respect to the coordinate 
axis of the brightness component in accordance with the 
distribution of the colors of the image data at the time of the 
restriction of the display colors, and thus determines the 
representative colors. 
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COLOR VARIATION SPECIFICATION 
METHOD AND A DEVICE THEREFOR 



BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to a color variation speci- 
fication method, restricted color determination method, and 
restricted color determination device which are used when a 10 
digitized natural image is displayed on a color display 
device which is capable of simultaneously displaying only a 
small number of colors. 

2. Background Art 15 
In general, color images used in color display devices are 

displayed in terms of RGB color components; 8 bits of 
memory are allocated to each color component and digiti- 
zation is thus conducted Accordingly, in a full-color display 
which displays the above digitized color image, it is possible 20 
to simultaneously display a number of colors corresponding 
to 24 bits with respect to each picture element, that is to say, 
to display 2 24 colors so that it is possible to display an image 
with a natural look. 

In contrast, in the world of CD-ROM and CD-I, CAD 25 
(Computer Aided Design), CAI (Computer Assisted Instruc- 
tion), and graphics, it is frequently the case that a color 
display device which is capable of simultaneously display- 
ing only a limited number of colors selected from among 
these 2 54 colors, is used. In such a case, the capacity of the 30 
image memory corresponding to a picture element is nor- 
mally 8 bits or fewer, so that the number of colors which can 
be simultaneously displayed is 2 8 =256. 

In addition, if the number of colors is limited to 256 or 
fewer, it is difficult to display a natural image without 35 
deterioration. Therefore there has been a great demand for a 
device which will make such a display possible. 

Furthermore, with regard to the data capacity of the above 
display device or the like, there has been a great demand for 
a reduction in the amount of image data and the number of 40 
colors of the natural image so that the natural image will not 
suffer deterioration. 

Conventionally, there are known methods which have 
attempted to solve the problems where a natural image was 45 
displayed in terms of a restricted number of colors, while 
controlling visual degradation by means of a color map 
display in which a small number of display colors were 
selected from a large number of colors and displayed. 

For example, in the case in which colors were displayed 50 
in terms of values for each of the 3 colors R, G, and B, a 
space in which a 3-dimensional rectangular coordinate sys- 
tem using as coordinates thereof the values for each of R, G, 
and B, was expressed and used as a color space in such a 
method. In this color space, each picture element of the color 55 
image data was given coordinates corresponding to its RGB 
values, and an analysis of the distribution of the colors of 
each picture element included in the color image data was 
conducted. 

Furthermore, a large number of display colors was 60 
selected from color regions within the color space for which 
the distribution of the picture elements of the color image 
data was large, and a small number of display colors was 
selected from color regions in which the distribution of the 
picture elements of the color image data was small. The 65 
selected display colors were recorded on a color map, and 
the closest display color was allocated to each picture 



2 

element of the color image data as a representative color. 
Then, by means of writing the color code, recorded as the 
representative color at the position of each picture element 
of the image memory into a color map, an approximation of 
the image was displayed. 

Among methods for the selection of representative colors 
as described above, an example thereof is a method using 
Otsu*s discriminant analysis Shingakuron (THE TRANS- 
ACTIONS OF THE IECE OF JAPAN) (D)J63-D, pp. 
349-356, 1980-4, and the English abstracts thereof, THE 
TRANSACTIONS OF THE IECE OF JAPAN, VOL. E63, 
NO. 4, APRIL 1980, pp. 327-328. 

Furthermore, among color spaces, there exist not merely 
color spaces which express colors by means of combining 
the three primary colors RGB, but also by means of using 
uniform color spaces such as the CIELUV color space, 
CIELAB color space, and the like [recommended by the CIE 
(Commission Internationale de rEclairage)] which take into 
consideration the visual characteristics of color discrimina- 
tion by human beings. In addition, it is possible to conduct 
the above-described . discriminatory method of analysis 
using these color spaces. 

Furthermore, a method which utilizes the visual charac- 
teristics of color discrimination by human beings, and fur- 
thermore applies the Dither method (Journal of the Elec- 
tronic Imaging Conference, Vol. 18, No. 5 (1989) pp. 
293-301; Tajima, Dceda) has been proposed. However, in 
this method, consideration is not given to the case in which 
restricted color display is conducted using a small number of 
colors, for example, fewer than 100. 

In restricted color determination methods utilizing a con- 
ventional discriminatory method of analysis, the color dis- 
tribution was analyzed and a large number of display colors 
was selected from color regions having a large distribution, 
while a small number of display colors was selected from 
color regions having a small distribution, and the closest 
representative color was allocated to each picture element. 
In the case in which representative colors were determined 
and in which portions in the variations of the colors (the 
values for each of R, G, and B) in each picture element were 
loose, it was possible to represent the colors of each picture 
element by means of a small number of representative colors 
using this method. However, in such a case, pseudo color 
contouring was often generated What is meant here by 
"pseudo color contouring" is a phenomenon in which quan- 
tization errors, occurring in portions of the image in which 
the brightness gradient is loose, have the appearance of 
contour lines on a map, and thus present a large flaw in the 
image when displayed (Image Processing Handbook, Image 
Processing Editing Committee, Shokodo, 1988, p. 191). 

For this reason, it was necessary to visually select the 
portions in which the color variation was loose, to conduct 
processing of these portions which was separate from that of 
the other image portions, and for an operator to manually 
make the corrections at the locations where the pseudo color 
contouring had occurred after discriminant analysis. There- 
fore, the process to eliminate pseudo color contouring was 
extremely burdensome. 

Furthermore, in the conventional technology which used 
the above-described Dither method, a Dithering process was 
adopted which conducted the appropriate weighting of 
regions in which the color difference between picture ele- 
ments in a certain vicinity was small. However, in this 
Dithering process, only an exchange of colors of each 
picture element within a predetermined range of colors was 
conducted, so that while pseudo color contouring was con- 
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trolled, a diffusion of color occurred with respect to the 
image as a whole. 

Furthermore, even when the discriminatory method of 
analysis was used in a CEELUV color space or in a CEELAJB 
color space, which take into account the visual characteris- 5 
tics of color discrimination by human beings, an image 
which approximated a natural image when viewed by the 
human eye could not be obtained. 

Furthermore, among conventional methods and in addi- 
tion to the non-adaptive methods such as the above-de- 10 
scribed discriminatory method of analysis and the like, in 
which an image was created by the selection of a limited 
amount of display colors independent of the state of the 
original image, for example, independent of the color dis- 
tribution thereof, there also existed adaptive methods which 15 
selected a restricted number of colors so as to be adapted to 
the statistical characteristics of the color distribution and the 
like of the original image. 

The above-described adaptive methods were superior to ^ 
the non-adaptive methods with respect to image quality. 
However, it was necessary to determine color distribution 
and the like for all the image data, and it was also necessary 
to alter the method of statistical processing in accordance 
with the state of the color distribution so that the processing ^ 
became complex overall, and the processing period became 
lengthy. 

Accordingly, non-adaptive methods, which maintained a 
certain amount of image quality with respect to general 
image data, have been developed to a greater extent than the 30 
adaptive methods. The advantages to non-adaptive methods 
are that they arc not particularly selective and that the 
processing period is short However, among the natural 
images which furnish the image data, there are images which 
have statistical characteristics such as color distribution and 35 
the like, which differ extremely based on the content thereof 
so that the superiority of adaptive methods from the point of 
view of image quality remains unchallenged. 

SUMMARY OF THE INVENTION 40 

In view of the shortcomings of the technologies described 
above, the present invention provides a method for deter- 
mining whether a portion in which the colors vary in a loose 
manner exists in the above described image data, by means 45 
of investigating whether periodicity exists at subordinate 
bits of the value of each picture element disposed in a 
connected manner in the image data. 

Furthermore, the present invention provides a method for 
the allocation of the number of display colors of the image 50 
data at the time of the reduction, for example a number 
corresponding to 24 bits to a number corresponding to 8 bits 
or fewer, by means of the discriminant analysis of the values 
of each picture element of the image data of a large number 
of display colors, to color regions corresponding to the 55 
portions specified as having loose color variation by means 
of the above method, and for the display of the above- 
described image data by means of restricted display colors 
in a state in which the generation of pseudo color contouring 
is prevented. ^ 

Furthermore, the present invention provides a method for 
the allocation of a large number of display colors as a result 
of variations in brightness with respect to the chromaticities 
within the color components or, alternatively, for the display 
of image data by means of restricted display colors in 65 
correspondence with the tint characteristics of the image 
data, at the time of the reduction of display colors by means 
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of m^crirainant analysis of the values of each picture ele- 
ment of the image data, as described above. 

Furthermore, the present invention provides a device for 
displaying image data by means of restricted display colors 
using the methods described above. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram showing the above-described 
restricted color determination device of the preferred 
embodiment. 

FIG. 2 is a diagram which serves to explain the restricted 
color determination method of the above preferred embodi- 
ment. 

FIG. 3 is a diagram which serves to explain the above 
restricted color determination method. 

FIG. 4 is a diagram showing a coordinate system which 
serves to explain the restricted color determination method 
described above. 

FIG. 5 is a diagram showing a coordinate system which 
serves to explain the restricted color determination method 
described above. 

FIG. 6 is a histogram which serves to explain the 
restricted color ^termination method described above. 

FIG. 7 is a graph which serves to explain the restricted 
color detennination method described above. 

FIG. 8 is a histogram which serves the purpose of 
explaining the restricted color determination method 
described above. 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENTS 

Hereinbelow, a preferred embodiment of the present 
invention will be explained with reference to the diagrams. 

FIG. 1 is a block diagram showing an apparatus for 
determining restricted color in accordance with the present 
preferred embodiment, while FIGS. 2 through 8 are dia- 
grams for the purpose of explaining the restricted color 
determination method in accordance with the present pre- 
ferred embodiment 

Hereinbelow, with reference to FIG. 1, an explanation will 
be given of the restricted color determination device in 
accordance with the present preferred embodiment 

Hie above-described restricted color determination 
device has a structure having as main components thereof: 
an image memory mechanism 1, which stores image data; a 
subordinate 3 bit memory mechanism 2, which stores the 
subordinate 3 bits of the above image data; a periodicity 
calculation mechanism 3 which, in the above subordinate 3 
bit image data reads the subordinate 3 bit values of picture 
elements surrounding each picture element along radial 
directions; finds the periodicity of the subordinate 3 bits of 
the picture elements which were read, and normalizes this 
periodicity; a periodicity coefficient memory 4, which stores 
the periodicity which was normalized by means of the 
above-described periodicity calculation mechanism 3 as a 
coefficient; color conversion mechanism 5 which converts 
the above-described image data, which comprise RGB val- 
ues, into values in a CIELAB color space; a cluster image 
memory mechanism 6 which finely differentiates the 
CIELAB color space into a plurality of clusters by means of 
the ranking numbers determined at the time at which the 
frequency distribution of each picture element along the L*. 
a*, and b* coordinate axes was found, assigns cluster 
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numbers to these clusters, and stores the picture element 
values which have been converted into CIELAB values, 
replacing these values with the cluster numbers of the 
clusters containing these picture elements; a histogram cal- 
culation mechanism 7 which finds the frequency distribution 5 
of the picture elements of each cluster along each coordinate 
axis of the above-described CIELAB color space; a histo- 
gram memory mechanism 8 which stores the histograms 
which were thus determined; an average and dispersion 
calculation mechanism 9 which determines the average io 
color and dispersion from the above-described histograms; 
an average and dispersion memory mechanism 10 which 
stares the averages and dispersions which were thus 
obtained; a first principal axis calculation mechanism 11 
which finds a first principal axis; a first principal axis 15 
memory mechanism 12 which stores the first principal axis 
which was thus determined; a weighted dispersion calcula- 
tion mechanism 13 which finds the weighted dispersion; a 
division threshold determination mechanism 14 which finds 
division thresholds by means of discriminant analysis; a 20 
dispersion threshold memory mechanism 15 which stores 
the dispersion thresholds which were thus obtained; a color 
region division mechanism 16 which conducts division into 
color regions by means of division thresholds in accordance 
with the above-described weighted distribution and first 25 
principal axis; a division control mechanism 17 which 
controls the repetition of the processing of each mechanism 
described above, to the point at which either color regions 
which can be divided no longer exist or the number of color 
regions into which the color space was divided reaches a 30 
preset number of display colors; an emphasis coefficient 
designation mechanism 18 which designates, prior to each 
division into color regions, the factor (1/8-32) ranking 
numbers on the coordinate axis showing the brightness 
component L*. in accordance with the dispersion ratios with 35 
respect to all coordinate axes of a CIELAB color space, 
which are to be multiplied, with respect to the ranking 
numbers in the coordinate axes showing the chromaticity 
components a* and b*; a ranking numbers calculation 
mechanism 19 which finds the ranking numbers of each 40 
coordinate axis by the means of the multiplying factor 
(emphasis coefficient) designated by means of the emphasis 
coefficient designation mechanism 18; a ranking numbers 
memory mechanism 20 which stores the ranking numbers of 
each coordinate axis determined by the ranking numbers 45 
calculation mechanism 19; a histogram renewal mechanism 
21 which conducts the weighting revision of the above- 
described histogram read-out from histogram memory 
mechanism 8, by means of the periodicity coefficient read- 
out from the above-described periodicity coefficient 50 
memory mechanism 4, and updates the ranking numbers of 
the histogram to the ranking numbers stored in the above- 
described ranking numbers memory mechanism 20, rewrites 
the histogram, and stores the rewritten histogram in a 
histogram memory mechanism; a reverse color conversion 55 
mechanism 22 which reads the restricted colors obtained by 
the operations of each of the above mechanisms 2-21 from 
the average and dispersion memory mechanism, and con- 
ducts conversion which is the opposite of that of the color 
conversion mechanism 5; a representative color allocation 60 
mechanism 23 which replaces the colors of each picture 
element with restricted colors; a restricted color pallet 
mechanism 24 which sorts the above-described restricted 
colors by means of distance in the color space, and records 
the representative colors in a color map 30a; a color cor- 65 
rection mechanism 25 which makes possible localized color 
correction on a screen on which image data which have been 
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replaced by the above-described representative colors are 
displayed in close proximity; and a repetition control mecha- 
nism 26 which controls the repetition of the conducting of 
the operations of each of the above-described mechanisms 
2-21 with respect to the restricted colors obtained by means 
of conducting the operations of each of the above-described 
mechanisms 2-21. 

The image memory mechanism 1 possesses an image 
memory 10c, herein, the values (R, G, B) of each picture 
element of the image data are stored and each color com- 
ponent is allotted 8 bits. 

The subordinate 3 bit memory mechanism 2 stores the 
subordinate 3 bits of the values (R, G t B) of each picture 
element of the image data stored in the image memory 
mechanism 1. 

Periodicity calculation mechanism 3 reads the subordi- 
nate 3 bit data for each picture element out of the subordi- 
nate 3 bit memory mechanism 2; measures the frequency of 
the appearance of identical values, in cycles of less than 4 
picture elements, in the subordinate 3 bits of picture ele- 
ments in the image which are disposed in a connected 
manner in a vertical, horizontal, diagonal right, or diagonal 
left radial direction around each picture element; and by this 
means determines the periodic values described hereinafter 
for each picture element. Furthermore, this mechanism 
deterinines the proportion for each picture element as a 
periodicity coefficient, when the largest value of the periodic 
value is set to a value of 1. 

Periodicity coefficient memory mechanism 4 stores the 
periodicity coefficients of each picture element an a array 
that is identical to that of the picture element. 

Color conversion mechanism 5 converts the RGB values 
of each picture element in the image data to CIELAB color 
space coordinates. 

Cluster image memory mechanism 6 finely differentiates 
the CIELAB color space into clusters by means of the 
rankings of each coordinate, replaces the value of the picture 
elements contained in each cluster with the cluster number, 
and stores these values. 

Histogram calculation mechanism 7 determines the fre- 
quency distribution of each picture element belonging to 
each cluster and creates a histogram, and stores this in 
histogram memory mechanism 8, 

Average and dispersion calculation mechanism 9 deter- 
mines the average and dispersion of the picture element 
distribution Jor each coordinate axis in the CIELAB color 
space or the color regions into which the CIELAB color 
space was dividcd_bx means of thresholds. 

The first principal axis calculation mechanism 11 deter- 
mines the largest coordinate axis of the dispersion read out 
from the average and dispersion memory mechanism 10, in 
the CIELAB color space or in the color regions into which 
the CIELAB color space was divided by means of thresh- 
olds, and makes this coordinate axis a first principal axis. 

The first principal axis obtained in this way is stored in the 
first principal axis memory mechanism 12. 

The weighted dispersion calculation mechanism 13 deter- 
mines a weighted dispersion by means of multiplying the 
dispersion by the relative frequency of the number of picture 
elements contained in the color regions, with respect to the 
total number of picture elements. 

Division threshold determination mechanism 14 deter- 
mines division thresholds by means of the above-described 
discriminant analysis. 

Division threshold memory mechanism 15 stores the 
division thresholds which were obtained by means of the 
division threshold determination mechanism 14. 
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Color region division mechanism 16 sorts the weighted 
dispersion values of each region obtained by means of the 
weighted dispersion mechanism 13, finds the color region 
having the largest weighted dispersion, reads the first prin- 
cipal axis of this color region (in the case of the initial 5 
division, it is the color space) from the first principal axis 
memory mechanism 20, and divides this color region (i.e. 
color space) in 2 by means of the division threshold of the 
first principal axis which was read out of the division 
threshold memory mechanism 15. 1Q 

Division control mechanism 17 controls the repetition of 
the above-described calculations and divisions with respect 
to each color region, until a point at which the total number 
of color regions into which the color space was divided by 
means of the color region division mechanism 16 reaches a 15 
preset number of colors or further division cannot be con- 
ducted. 

f After the above division has been completed, representa- 
tive color allocation mechanism 23 reads the average color 
for each color region out of the average and dispersion 2 o 
memory mechanism 10, and adopts this average color as the 
representative color for each color region. Furthermore, in 
\he original image data, representative color allocation 
mechanism 23 allocates the average color of each color 
region to the picture elements which are contained in that 25 
color region, and replaces the color of the picture elements 
of the original image data with the representative color. The 
image data, which now have the color of each picture 
element replaced by the representative color, are stored in 
image memory 30d. 30 

With respect to the dispersion of each coordinate axis of 
the CIELAB color space determined by means of average 
and dispersion calculation mechanism 9, emphasis coeffi- 
cient designation mechanism 18 determines a ratio between 
each of the coordinate axes, and designates multiplying 35 
factors so that the ranking numbers on each of the coordinate 
axes are multiplied by V&, l A> 2, 4, 8, 16, or 32, with 
respect to other coordinate axes, in accordance with the 
above ratio. 

Emphasis coefficient calculation mechanism 19 deter- 40 
mines the ranking numbers on each coordinate axis in 
accordance with the above ratio. 

Emphasis coefficient memory mechanism 20 stores the 
ranking numbers of each coordinate axis obtained by means 
of the ranking numbers calculation mechanism 19. 45 

Histogram renewal mechanism 21 totals the periodicity 
coefficients of each picture element read out of the period- 
icity coefficient memory mechanism 4 for each cluster in 
which the corresponding picture elements are included, and 5Q 
adds the periodicity coefficients totaled by cluster to the 
number of picture elements in each cluster of a histogram. 

Furthermore, histogram renewal mechanism 21 redivides 
the CIELAB color space into new clusters, which are 
different from the above-described clusters, on the basis of 55 
the ranking numbers of each coordinate axis stored in the 
above-described ranking numbers memory mechanism 20, 
and updates the above-described histogram to the number of 
picture elements of each new cluster resulting from this 
redivision. ^ 

That is to say, the CIELAB color space is divided into new 
clusters in accordance with the multiplication factors des- 
ignated by the above-described emphasis coefficient desig- 
nation mechanism 18, and based on these new clusters, the 
histogram is renewed. Accordingly, when a brightness coef- 65 
ficient is to be emphasized by a multiplication factor des- 
ignated by the emphasis coefficient designation mechanism 
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18, in addition to the weighting revision by means of the 
above-described periodicity coefficients and after the 
CIELAB color space has been divided into new clusters, the 
sum of the periodicity coefficients is determined for each 
new cluster. The histogram, based on the new clusters, is 
weighted by the sum of the periodicity coefficients of each 
new cluster and is thus corrected. 

In addition, histogram renewal mechanism 21 rewrites the 
histogram renewed in the above manner in place of the 
histogram stored in histogram memory 8. 

Restricted color pallet calculation mechanism 24 sorts the 
representative colors obtained, by means of the operation of 
each of the above mechanisms by distance in the color space 
and records the representative colors as color codes in the 
color map 30a 

In addition, color correction mechanism 25 operates in the 
following manner colors of the displayed image are sur- 
rounded with a rectangle by means of a mouse, and by 
placing the focus of the mouse on portions having colors 
which are to be changed within the rectangle and clicking, 
it is possible to select places or colors in the displayed image 
which are to be corrected. 

Furthermore, in the case in which colors selected by 
means of the color correction mechanism 25 are to be 
corrected and modified, there are two methods therefor, in 
one method, the colors which have been selected as 
described above are replaced by other representative colors 
which are recorded in the color map 30a described above. 
That is to say, after colors which are to be modified have 
been selected, color correction mechanism 25 displays the 
representative colors recorded in color map 30a as a color 
palette screen. Furthermore, the color palette screen thus 
displayed displays colors having a small mutual color dif- 
ference in the uniform color space so as to adjoin each other, 
and the representative colors which have been selected as 
described above and are to be modified are displayed in a 
flashing manner. 

In addition, for example, by means of finding represen- 
tative colors which approximate the representative colors 
which are to be modified in the color palette screen, and 
designating these representative colors on the color palette 
screen, it is possible to replace the representative colors 
which are to be modified with the designated representative 
colors. That is to say, it is possible to replace the represen- 
tative colors of the area of the displayed image designated by 
means of the mouse with other representative colors. 

In this case, only the color of the area of the displayed 
image which was originally designated by means of the 
mouse is replaced with one previously determined repre- 
sentative color. 

In another color correction and modification method, the 
representative colors recorded in color map 30a are modi- 
fied; after representative colors which are to be modified 
have been selected as described above, the color palette 
screen is displayed, and the selected colors are displayed in 
a Mashing manner. Furthermore, in addition to the above- 
described color palette screen, a 24-bit full-color color 
palette is displayed. Then, in the case of this correction 
method, the colors which have been selected from the above 
representative color color palette are replaced with colors in 
the full-color color palette designated by means of the 
mouse. 

That is to say, by means of conducting the above opera- 
tions, with respect to the selected representative colors, the 
data of color map 30a themselves are modified, and in the 
displayed image, in portions which use representative colors 
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which are identical to the selected representative colors, 
even if these portions are outside the area which was 
designated by means of the mouse, all colors are modified. 

The restricted color determination device having the 
above structure displays full color image data on a color map 5 
display device 30 using restricted display colors and utiliz- 
ing a restricted color determination method. 

In the present preferred embodiment, the color map 
display device 30 is capable of displaying the image data 
stored in the image memory mechanism in full color, by 10 
visually comparing the full color image and the image 
displayed in restricted colors, it is possible to correct the 
colors using the above-described color correction mecha- 
nism 28. Reference numeral 30c indicates a D/A convertor 
for the purpose of displaying on display 30& the image data 15 
of the image memories 10a and 30J. 

Next, the restricted color determination method used by 
this restricted color determination device will be explained. 
(1) Measurement of Chromaticity Variation of the Image 
Data which are to be Displayed 20 

In conventional methods, when a measurement was made 
of the degree of variation in the colors of the image data, that 
is to say, when measurements were made as to whether the 
colors of each picture element in the image differed greatly 
from the colors of the picture elements in the vicinity, or 25 
whether these colors were roughly equivalent, a measure- 
ment method which used the superordinate 5 bits of the RGB 
data of the image displayed in terms of 8 bits for each of R, 
G, and B was employed. 

However, the data which exhibited the looseness of the 30 
color variation were usually included in the subordinate 3 
bits which were lost by means of this method. That is to say, 
in image data having a small color variation, it was impos- 
sible to measure the chromaticity variation by comparing the 
superordinate bits of each picture element, so that it was 35 
impossible to distinguish portions in which the color varia- 
tion was extremely loose from portions in which the color 
variation was somewhat loose. 

In the present preferred embodiment, by means of deter- 
mining the periodicity of the values of the subordinate 3 bits 40 
in each color component, it is possible to specify the 
looseness of the color variation in the image data which are 
to be displayed. 

The values of the subordinate 3 bits are limited to the 8 
possibilities from 0 to 7. In the case in which color variation 45 
is loose as a result of differences in position of each picture 
element of the image, the data values of each picture element 
change continuously with a small amount of fluctuation 
between picture elements which are disposed in a connected 
manner. Accordingly, in portions having a loose color varia- 50 
tion, a fixed threshold appears almost as a rule within the 
range from 0 to 7 of the subordinate 3 bits. 

In the present preferred embodiment, as shown in FIG. 2, 
using each picture element 41 as a central point, the peri- 
odicity calculation mechanism 3 reads the subordinate 3 bits 55 
(those stored in subordinate 3 bit memory mechanism 2) of 
the picture elements disposed in a connected manner in the 
8 radial directions: vertical (up, down), horizontal Qeft, 
right), diagonal left (left upward, right downward), and 
diagonal right (right upward, left downward). Periodicity 60 
calculation mechanism 3 then determines the regularity 
(periodicity) for each RGB color component. 

As shown in FIG. 3, in the concrete periodicity calcula- 
tion method of the periodicity calculation mechanism 3, 
first, the value of the subordinate 3 bits of the digital data of 65 
picture elements 41 is read, while moving regularly in the 
above described directions for one picture element at a lime, 
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until values which are equal to the values of the subordinate 
bits of an object picture element 41a are discovered. Then, 
when the number of picture elements moved prior to the 
discovery of equivalent values is less than 4, the subordinate 
3 bits are read while moving in a continuous manner to 
neighboring picture elements until identical values are dis- 
covered. If the number of picture elements moved when the 
latter identical values were discovered is equal to the num- 
ber of picture elements moved originally, it is determined 
that the object picture element 41a possesses periodicity. 

Then, while the same values appear periodically with the 
same number of moves, the subordinate 3 bits of the color 
data of picture elements 41 are read while moving in the 
above-described directions. Furthermore, the number of 
times these same values appear at the same number of moves 
is counted. When the same value fails to appear periodically, 
the reading of the picture element data is halted. 

The above operations are conducted with respect to all 8 
directions, and the total counted number of appearances of 
identical values is defined as the periodic value of the object 
picture element 41a, Furthermore, further operations utilize 
all picture elements 41 of the image data as object picture 
elements 41a. This type of measurement of the periodic 
value is conducted for each RGB color component. 

In the case shown in FIG. 3, for example in the above 
operations, when a picture element 41a in the image data is 
the object, there are cases when the values of the picture 
elements 41 connected in a horizontal direction (in a right- 
ward direction in FIG. 2) from this picture element 41a are 
examined and picture elements 41b having identical values 
are discovered (for example, at intervals of 3 picture ele- 
ments). In such a case, the number of appearances of 
identical values appearing at 3 picture element periods is 
counted, identical operations are conducted with respect to 
the radial directions, the number of appearances of identical 
values is counted, the numbers are all added, and the result 
is set as the periodic value of the object picture element 41a. 

Next, the periodic values of all color components are 
added for each picture element Then, the sum of the 
periodic values for each picture element is calculated at a 
ratio having a peak of 1, and this is defined as the weighting 
ratio which is used in the weighting which will be described 
hereinbelow. 

The weighting coefficient (periodicity coefficient) b £ is 
determined by means of the following formula 

Here, i indicates each picture element, a,- indicates the sum 
of the periodic values in each picture element, and a^ 
indicates the largest periodic value % (maximum value) 
among the sums a, of each periodic value. 

The periodicity coefficient b ( obtained in this manner is 
stored in periodicity coefficient memory mechanism 4. 

In addition, in histogram renewal mechanism 21, a peri- 
odicity coefficient b, is allocated to the position of each 
picture element converted into a uniform color space, and 
the periodicity coefficients b ( - are disposed at the positions of 
each picture element in the uniform color space. 

In addition, in the uniform color space divided into 
clusters, when the histogram showing the number of picture 
elements contained in each cluster is renewed in histogram 
renewal mechanism 21, the various periodicity coefficients 
b f of the picture elements contained in each cluster are 
added, and the sum of these periodicity coefficients b f 
becomes the weighting coefficient for each cluster. Then, 
these weighting coefficients are added to the number of 
picture elements in each cluster, and this becomes a new 
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X=O.61#HM7G*0.20B 
K=O.30/?+O.59G+O.ll£ 
Z=O.066G+U2fl 

In the case in which Y/Yn>0.008856: 

L^=116(r/yn) l/5 -16 

In the case in which Y/Yn£0.008856: 

L^903.3(r/Kn) 



b*=2J00[(Y/Yn)^-(^Zny n \ 



histogram. Furthermore, when a discriminant analysis is 
conducted with respect to the first principal axis, the number 
of picture elements for each ranking along the first primary 
axis (i.e. the frequency distribution with respect to the first 
primary axis) is determined from the histogram produced in 5 
the above manner. The number of picture elements con- 
tained in each ranking of the first principal axis from this 
frequency distribution is then divided by the total number of 
picture elements, a picture element generation probability is 
determined, and this generation probability is used. 
(2) Selection of Representative Colors 

In order to select representative colors, first, the color 
distribution of the image data was disposed in a color space; 
however, in considering the visual characteristics of color 
discrimination by human beings, uniform color spaces were 
used at this time. The above-described CIELUV or CIELAB 15 
was used as the equivalent color space. The values of each 
picture element of the image data comprising RGB data 
were converted to CIELUV or CIELAB. In the present 
preferred embodiment, as an example, a detailed explanation 
will be given of a case in which this conversion is conducted 
using CIELAB and by means of color conversion mecha- 
nism 5. 

The conversion of RGB data to CIELAB is carried out 
according to the following formulas with the inclusion of the 
XYZ system which was recommended by the CIE in 1931. 



20 



25 



(la) 
(lb) 
(lc) 



30 



(2a) 



35 



(2b) 



In the case in which X/Xn>0.008856, Y/Yn>0.008856, 40 
and Z/Zn>0.008856: 



(2c) 
(2d) 



45 



In the case in which X/Xn, Y/Yn f or Z/Zn is less than 
0.008856, the items (X/Xn) 173 ^ , (Y/Yn)*, and (Z/Zn)""^ 
1/3 in the formulas (2c) and (2d) above are replaced by 7.787 
(XOCnH167ll6, 7.787 (Y/Yn)+167116, and 7.787 (Z/Zn)* 
167116. 50 

Here, the chromaticities of R, G, B, and white are in 
conformity with the NTSC television standards. 
(3) Frequency Distribution of Picture Elements in the 
CIELAB Color Space 

At the stage at which the values of each picture element 55 
have been converted from RGB to CIELAB, these values 
diverge from 8 bit integer values. In order to determine the 
frequency distribution in the CIELAB color space, it is 
necessary to determine the ranking numbers along each 
coordinate axis, to divide the CIELAB color space into 60 
clusters, based on the rankings along each coordinate axis, 
and to determine the number of picture elements contained 
in these clusters. 

An improved version of Watanabe's algorithm (Electronic 
Data Communication Study Papers D, Vol. J70-D, No. 4, pp. 65 
720-726, April, 1987) was used in the division of the 
CIELAB color space into the necessary number of colors 
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and the selection of average colors for each color region as 
representative colors. 

As a principal improvement, values converted from RGB 
8 bit values into CIELAB values were used in place of the 
RGB superordinate 5 bits as the original data. By means of 
this improvement, it was possible to utilize the 8 bit accu- 
racy of the data. 

Furthermore, by converting the ranking numbers along 
each coordinate axis of the initial space which is divided 
from, for example, RGB 32x32x32 to CIELAB 265x64x64, 
the ranking numbers on the coordinate axis showing the 
brightness component L* are 4 times greater than the 
ranking numbers along the coordinate axes showing the 
chromaticity components a* and b*, so that this brightness 
component L* is emphasized As reported by Kira, et al., 
(Communications Technology IE83-92, "Adaptive Natural 
Color Image Display by Means of a Restricted Number of 
Representative Colors*', Kira, Inoue, Fukui), the visual char- 
acteristics of human beings are such that sensitivity to 
brightness distribution is approximately 4 times that of the 
sensitivity to chromaticity components. 

To explain concretely, the image data which are inputted 
are normally RGB values arranged in order of the picture 
elements. When an RGB space is used by employing RGB 
values as coordinates, the RGB space uses R, G, and B as 
coordinate axes and is a 3-dimensional space having 8 bit 
values. That is to say, the values are within a range of 0-255 
in each coordinate axis thereof. By applying the number of 
picture elements having the RGB values of a point in the 
space, a histogram can be determined for each color com- 
ponent. 

That is to say, the histogram (r, g, b) equals the total 
number of picture elements of RGB (r, g, b). 

Next, in the case of a histogram of a uniform CIELAB 
color space, such a histogram is obtained by means of the 
conversion of the values (r, g, b) of each picture element 
displayed in terms of the above RGB into the values (L*, a*, 
b*) on the basis of the formula described above. 

That is to say, the histogram (L*, a*, b*) equals the total 
number of picture elements of CIELAB (L*, a*, b*) . 
However, the RGB values are expressed in terms of 8 bit 
digital data, so that these data have values which are integral 
within a range of 0-255, but the (L*, a*, b*) values obtained 
by means of the above conversion calculation have values 
which diverge from these integers within a range of 0-255. 
Accordingly, it is necessary to provide appropriate ranking 
numbers in the creation of the histogram. Furthermore, at 
this time, ranking numbers are provided so as to emphasize 
the brightness component 

In the present preferred embodiment, the brightness, that 
is to say, the L* component, is emphasized as described 
above, and in order to prevent an increase in the data 
capacity resulting from the conversion into CIELAB, it is 
necessary to determine the ranking interval of each 
CIELAB. As each RGB value is expressed in terms of 8 bits, 
the largest data capacity is set to 8 bits. Accordingly, this 
means that the brightness L* which is emphasized, receives 
a value within a range of 0-255. The L* component of the 
picture element obtained by means of the above formula is 
thus given a value within a range of 0-255 in accordance 
with its size. 

Furthermore, as the brightness component is emphasized 
by a factor of 4 with respect to the a* and b* components, 
the relationship a*, b*:L* has a value of 1:4. That is to say, 
the a* and b* components receive 6 bit values within a range 
of 0-63. 

Here, the calculation of the actual ranking intervals is 
conducted in accordance with the following formulas when 
the CIELAB data is transformed to data of less than 8 bits. 
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L* interval=(L*max-L*min)/(256/m) 

a* interval=<a*max-a*min)/(256/n) 

b* interval=(b*raax-b*min)/(256/n) 

The references L* interval, a* interval, and b* interval 
indicate the ranking intervals of L*, a*, and b*. 5 

The references L*max, a*max, and b*max indicate the. 
maximum values of L*, a*, and b* ( respectively. 

The references L*min and b*min indicate minimum val- 
ues of L*, a*, and b*, respectively. 

Furthermore, the references m and n vary according to the 10 
ratio between the brightness component (L*) and the chro- 
maticity components (a* and b*); in the present preferred 
embodiment, as the ratio L*:a*, b* has a value of 4:1, the m 
of the brightness component has a value of 1, while the n of 
the chromaticity components has a value of 4. 15 

In addition, the CIELAB color space having ranking 
intervals determined as described above is divided in 3 
dimensions by means of the rankings along each coordinate 
axis, and these divided regions are used as color clusters. A 
cluster number is then assigned to each cluster. Next, the 20 
value of each picture element is replaced by the cluster 
number of the cluster in which this picture element is 
contained, and this is stored in cluster picture element 
memory mechanism 6. 

Next, by means of histogram calculation mechanism 7, 25 
the frequency distribution for each cluster of the image data 
is determined. 

A brief explanation will be made, with reference to FIGS. 
4 and 5, of the case in which the ranking numbers of the 
coordinate axis indicating brightness are made larger than 30 
the ranking numbers of the coordinate axes showing the 
chromaticities, and representative colors are selected by 
means of discriminant analysis. 

In FIGS. 4 and 5, to facilitate ease of understanding, 
explanation will be given with reference to a 2-dimensional 35 
coordinate system having as one axis thereof a coordinate 
axis indicating the chromaticity in a uniform color space. 

First, the y-axis indicates brightness, while the x-axis 
indicates chromaticity, and in the case in which the ranking 
numbers thereof are set at 8, the color space is divided by 40 
means of discriminant analysis as shown in FIG. 4. By 
means of setting the ranking numbers along the x-axis to a 
value of 4, in the case in which the ranking numbers along 
the y-axis are double those along the x-axis as shown in FIG. 
5, the portions of the x-axis which were divisible in FIG. 4 45 
become indivisible, and the number of divisions along the 
brightness axis increases by this amount That is to say, in 
the case in which the average colors of the divided color 
space are used as representative colors, those colors having 
the same tint but differing degrees of brightness are selected 50 
as representative colors in large numbers, while colors 
having differing tints are rarely selected, so that represen- 
tative colors which have emphasized brightness are selected. 
(4) Emphasis of Brightness or Chromaticity 

In the present preferred embodiment, in the above- de- 55 
scribed space division system, by means of the emphasis on 
sampling of the brightness component, attention is paid to 
the emphasis of portions where the changes in the brightness 
component are loose, that is to say, to the fact that the 
division using the brightness direction as the first primary 60 
axis is the primary division. Furthermore, on the other hand 
wherein the brightness component is emphasized, portions 
and colors having loose brightness variation are specified by 
means of conductive sampling with respect to the brightness 
components. 65 

Concretely, in the CIELAB (or in the CIELUV) sampling 
which is emphasized by a factor of 16 so as to result in 
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256x16x16 colors is conducted in the brightness direction. 
The number of restricted colors is set to, for example, a 
small number such as 100 or the like, and the representative 
colors are determined by means of the division method (2) 
described above. By this means, 100 colors which are 
emphasized, in this case by a factor of 1 6, with respect to the 
brightness component are selected. These are the 100 super- 
ordinate colors consisting of the emphasized colors of the 
portions having variation in loose brightness. 

As explained above, emphasis coefficient designation 
mechanism 18 finds the ratio between all coordinate axes 
with respect to the dispersion in the direction of each 
coordinate axis of the uniform color space determined by 
means of average and dispersion calculation mechanism 9, 
and selects in accordance with this ratio, a multiplying factor 
(emphasis coefficient) of the ranking numbers of the coor- 
dinate axis indicating brightness with respect to the ranking 
numbers of the coordinate axes indicating chromaticity; this 
multiplication factor is one of Vi V4, V£, 1, 2, 4, 8, 16, 32, and 
64. 

In addition, ranking numbers calculation mechanism 19 
determines the rankings of each coordinate axis in accor- 
dance with the multiplication factors determined in the 
above manner. For example, in the case in which the 
multiplication factor of the chromaticity components a* and 
b* with respect to the brightness coefficient L* is set to 2, the 
ranking numbers of the coordinate axis of each CIELAB 
become 256x128x128, and these ranking numbers and the 
ranking intervals determined by means of these ranking 
numbers are stored in ranking numbers memory mechanism 
20. 

(5) Histogram Changes 

Using the weighting coefficients of each picture element 
stored in the above described periodicity coefficient memory 
mechanism 4 and the ranking numbers stored in ranking 
numbers memory mechanism 19, the histogram stored in 
histogram memory mechanism 8 is renewed. 

First, an explanation of the renewal of the histogram using 
the periodicity coefficients stored in periodicity coefficient 
memory mechanism 4 will be given. 

The periodicity coefficients stored for each picture ele- 
ment in periodicity coefficient memory mechanism 4 are 
disposed at the positions of each picture element converted 
into a uniform color space, and then the periodicity coeffi- 
cients of the picture elements contained in each cluster are 
added by cluster. 

Next, a value consisting of the total of the sum of the 
periodicity coefficients added together by cluster and the 
number of picture elements of each cluster is used as the 
number of picture elements of each cluster, and a histogram 
is created which is then used as a new histogram. 

That is to say, by means of the addition of the histogram 
showing the sum for each cluster of the coefficients 44 stored 
in the periodicity coefficient memory mechanism 4, to the 
histogram 43 (in actuality, thus is a histogram in a uniform 
color space, i.e. in a 3-dimensional space; however, in order 
to facilitate explanation, a 1 -dimensional histogram is used) 
stored in the histogram memory mechanism 8, as shown in 
FIGS. 6 and 7, it is possible to obtain-the weighting cor- 
rected histogram 45 shown in FIG. 8. This histogram is then 
used for the selection of representative colors by means of 
discriminant analysis, which is subsequently conducted and 
discussed hereinbelow. 

Furthermore, histogram renewal mechanism 21 recon- 
structs the histogram using the ranking numbers stored in the 
above-described ranking numbers memory mechanism 20. 

In histogram calculation mechanism 7, a histogram was 
created using ranking numbers in which the chromaticity 
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component was emphasized by a factor of 4 with respect to 
the brightness component, irrespective of the color tone of 
the image data. However, the ranking numbers are deter- 
mined by the multiplication factor designated by means of 
the emphasis coefficient designation mechanism 18. 5 

In addition, the uniform color space is redivided into new 
clusters by means of the new rankings, and the number of 
picture elements of each new cluster is made into a new 
histogram. 

Furthermore, when emphasis is also to be conducted in 10 
addition to weighting by means of the above-described 
periodicity coefficients, the sum of the periodicity coeffi- 
cients of each new cluster is used as a weighting coefficient, 
the weighting coefficient is then normalized, and then mul- 
tiplied by the number of picture elements of each new 15 
cluster, and added to the number of picture elements of each 
new cluster, and a new histogram is made. Subsequently, the 
histogram stored in histogram memory mechanism 8 is 
updated to this new histogram obtained by the above- 
described manner. 20 
(6) Selection of Representative Colors by Means of the 
Discriminatory Method of Analysis 

The selection of representative colors by means of the 
^criminatory method of analysis of the present preferred 
embodiment is basically identical to that of the above- 25 
described background art; using the histograms of each color 
component, thresholds are found and the. color space is 
successively divided into a plurality of color regions at these 
thresholds. However, in the present preferred embodiment, 
a discriminant analysis is conducted using histograms which 30 
have been reconstructed by means of weighting by period- 
icity and the ranking numbers which have been emphasized. 

Here, a determination method for the thresholds T, by 
means of discriminant analysis will be explained 

If the number of picture elements of a region S is 35 
represented by N, and the number of picture elements in a 
freely selected ranking i of 1 coordinate axis is represented 
by n„ the probability of generation q, is shown by the 
formula given hereinbelow (number 1). At this time, the 
number of picture elements are determined from the histo- 40 
gram which has been renewed in the manner described 
above by means of histogram renewal mechanism 21. 

That is to say, values equivalent to the sum of the number 
of picture elements of each new cluster divided by means of 
the new ranking numbers and the weighting coefficients are 45 
set as the number of picture elements in each cluster, and a 
number of picture elements having added thereto the number 
of picture elements in each cluster contained in a freely 
selected ranking along 1 coordinate axis is used as the 
number of picture elements n,.. 



qj=n/N 



The minimization of the weighting dispersion sum &J 1 is 
equivalent to the maximization of the dispersion s B 2 



so 



HI 



Then, assuming that a section [a, b] has been divided into 
2 sections [a, k] and Ca [k+1, b] based on a value k on 55 
a coordinate axis (a value used as a ranking unit), in the case 
in which the generation probability of the picture elements 
in both sections is set to w lt w 2 , the average value is set to 
n^, m 2 , and the dispersion is set to S2 2 , a value k on the 
coordinate axis is set so as to minimize the weighting 60 
dispersion sum s^ 2 given by the formula given hereinbelow 
(number 2). 



[21 



65 
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between the 2 sections obtained in the formula given here- 
inbelow (number 3). 



13] 



The value k which maximizes s B 2 (that is to say, the 
thresholds T ( which are to be determined) can be succes- 
sively determined as shown in the formula given hereinbe- 
low (number 4). 



w{k) = w{k-l) + q k 
m(k) = ra(* - 1) + Jt^ 

Here, m T indicates a total average and is shown in the 
formula given hereinbelow (number 5). 



IS] m T = 



a£i£b 



In the above manner, it is possible to determine, the 
threshold T, of each color component. 

In addition, by means of the threshold T, thus obtained, 
first, the color space is divided into 2 regions; however, in 
each color component, the coordinate axis of the color 
component in which the dispersion s 2 was greatest was used 
as the first principal axis, and at the position on this first 
principal axis corresponding to the threshold T, of this color 
component, the color space was divided into 2 color regions 
by a dividing plane perpendicular to the first principal axis. 

Next, the sum s^ of the weighting dispersions of each 
color region resulting from this division was determined, 
these were compared among color regions, and the color 
region having the largest sum s^, 2 of the weighting disper- 
sions was used as the next region to be divided. Then, in this 
color region, a threshold T, and a first principal axis were 
determined, as was the case when the color space was 
divided, and this color region is then further divided into 2 
color regions. 

Next, among all color regions resulting from divisions, 
the color region having the largest sum s^ of the weighting 
dispersions is found, and the division into 2 sections of the 
color region which was thus found is repeated as stated 
above. 

Next, when the number of color regions resulting from the 
divisions becomes equal to the number of representative 
colors in which the display is to be conducted, the division 
is stopped. 

Next, the average values of each color component in each 
color region are converted from C3ELAB to RGB by means 
of a reverse color conversion mechanism 22 and used as 
representative colors. 

Then, these representative colors are recorded as color 
codes in color map 30a of color map display device 30. The 
color distribution in the color space of the color image data 
which are to be displayed and each color region are brought 
into correspondence, and a color which is close to the 
original color of each picture element is allocated to the 
picture elements of the image data from color map 30a as a 
color code. In this manner, image data having color codes 
allocated to each picture element and restricted colors are 
displayed in display 30& of the color map display device 30 
having a color map 30a in which the color codes are 
recorded. 

Furthermore, it is possible to store the restricted color 
image data in memory mechanisms and the like. An image 
which has been image processed can be instantaneously 
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displayed on display 30b, and the memory capacity of the 
restricted image data is reduced in comparison with that of 
the image data of the original natural image, so that a device 
having a small memory capacity can easily handle this data. 
(7) Determination of Representative colors by Means of 5 
Repetition of the Above Operations 

In the restricted color determination method of the present 
preferred embodiment, the selection of the restricted colors 
determined as described above is repeatedly conducted for 
the selected representative colors, and thereby, the represen- 1Q 
tative colors are reduced in stages. 

That is to say, repetition control mechanism 17 uses the 
image displayed in terms of the representative colors 
selected in the above-described manner as original image 
data, and again conducts selection of representative colors 
by means of the above-described operations. By means of 15 
repeating this process a set number of times, the number of 
representative colors is finally reduced to the necessary 
number. 

Furthermore, when repeatedly selecting representative 
colors in each repetition, a histogram is revised by means of 20 
the periodicity coefficient calculation mechanism 3 and 
ranking numbers calculation mechanism 19. By means of 
the histogram renewal mechanism, the histogram is 
weighted with respect to those portions in which the color 
variation is loose, and the brightness or the chromaticity is 25 
emphasized. 

Accordingly, with respect to statistical characteristics 
such as the chromaticity distribution and the brightness 
distribution, representative colors which are suited to the 
statistical characteristics of the image data are selected in the 30 
same manner as in the adaptive method by means of 
adjustments to the image data and reductions in the repre- 
sentative colors. 

As stated above, the restricted color determination 
method of the present preferred embodiment specifies por- 35 
tions in which the color variation is loose by means of the 
periodicity of the subordinate 3 bits of the image data. In 
using this periodicity as a coefficient, this method weights 
and revises the color distribution of the image, selects a large 
number of colors from portions in which the color variation 40 
is loose, and creates more ranking numbers for the coordi- 
nate axes indicating brightness than for the coordinate axes 
indicating chromaticity. In addition, by means of selecting a 
large number of colors having differing degrees of bright- 
ness, in line with the visual characteristics of human beings, 45 
this method prevents the occurrence of pseudo color con- 
touring. 

Furthermore, in comparing the dispersion on each coor- 
dinate axis of the brightness and the chromaticity, it is 
possible to select representative colors which are suited to 50 
the characteristics of the image data by further emphasizing 
the brightness with respect to image data in which the 
brightness variation is large, and emphasizing the chroma- 
ticity with respect to images in which the brightness varia- 
tion is small and which have a large number of tints. 55 

Furthermore, by means of reducing the number of repre- 
sentative colors in stages while repeatedly conducting the 
above operations, the measurement of the periodicity of the 
subordinate 3 bits and the comparison of the dispersion on 
each coordinate axis of the brightness of the chromaticity are 60 
repeated. By means of the repeated revision of the histogram 
in accordance therewith, it is possible to reduce the repre- 
sentative colors to those which are suited to the statistical 
characteristics of the image data. 

It is also possible to construct these processes as a 65 
program on a commercially available computer, and thus to 
execute the processing. 
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Furthermore, it is not absolutely necessary to set the 
memory capacity corresponding to each picture element of 
the original image data to 24 bits. In addition, it is not 
necessary to set the subordinate bits used in the specification 
of the color variation to the subordinate 3 bits. Also, it is 
possible to alter the number of subordinate bits which are 
used in accordance with the memory capacity allotted to 
each picture element of the original image data. 

Furthermore, a certain amount of processing time is 
necessary in order to reduce the number of colors by means 
of the present invention. However, when the compressed 
image which is obtained thereby is displayed, decoding 
processing is not necessary so that independent of the 
machine or system, it is possible to instantaneously display 
the compressed image having restricted colors. By this 
means, the restricted color determination method can be 
expected to be used in many manufacturing fields. 

In the present preferred embodiment, the periodic values 
of image data displayed in terms of RGB values were 
determined, and histograms of the image data converted into 
a CIELAB color space were revised. However, it is also 
possible to revise a histogram of the image data displayed in 
terms of RGB values using the above-described periodic 
values, and by means of conducting a discriminant analysis 
on the display colors of the image data in RGB values which 
were thus revised to reduce the number of display colors. 

What is claimed is: 

1. A color variation specification method comprising the 
steps of: 

reading least significant bits of digital data expressing 
values of the three primary colors of each picture 
element of image data, wherein the three primary colors 
are red, green and blue; 

determining a periodicity at which identical values are 
exhibited in said least significant bits of said picture 
elements disposed in a connected manner in said image 
data; and 

deterrnining relative strengths of color variations from 
periodicity data. 

2. A restricted color determination method comprising the 
steps of: 

reading least significant bits of digital data expressing 
values of the three primary colors of each picture 
element of image data, wherein the three primary colors 
are red, green and blue; 

determining a periodicity at which identical values are 
exhibited in said least significant bits of said picture 
elements disposed in a connected manner in said image 
data; 

determining weighting coefficients based on periodicity 
data; 

conducting weighting revision of a histogram of each of 
said picture elements of said image data in a 3 -dimen- 
sional space by means of said weighting coefficients; 

determining representative colors by utilizing a discrimi- 
nant analysis with respect to the revised histograms; 
and 

approximating said image data by means of said repre- 
sentative colors. 

3. A restricted color determination method in accordance 
with claim 2, wherein said periodicity data represent totals 
of a number of appearances of identical values in said least 
significant bits occurring periodically and in succession 
within a prescribed interval in said picture elements dis- 
posed in radial directions from each of said picture elements 
of said image data. 
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4. A restricted color determination method comprising the 
steps of: 

a) disposing, based on values of the three primary colors 
red, green, and blue, each picture element of image data 
in a uniform color space having one coordinate axis 5 
representing a brightness component and two coordi- 
nate axes representing chromaticity components; 

b) setting a ranking number in a coordinate axis indicating 
a brightness component of said uniform color space, 
setting a ranking number, different from the ranking 10 
number set in the coordinate axis indicating a bright- 
ness component, in each of the two coordinate axes 
indicating chromaticity components of said uniform 
color space, and dividing said uniform color space by 
means of the ranking numbers set in each of said 15 
coordinate axes; 

c) determining a histogram of picture element distribution 
in the divided uniform space; 

d) determining representative colors by utilizing a dis- 
criminant analysis with respect to said histogram; and 20 

e) approximating said image data by said representative 
colors. 

5. A restricted color determination method in accordance 
with claim 4, wherein more of said ranking numbers exist in 
said coordinate axis indicating said brightness component of 25 
said uniform color space than said ranking numbers exist in 
said coordinate axes indicating chromaticity components in 
said uniform color space. 

6. A restricted color determination method in accordance 
with claim 4, wherein more of said ranking numbers exist in 30 
said coordinate axes indicating chromaticity components of 
said uniform color space than said ranking numbers exist in 
said coordinate axis indicating said brightness component in 
said uniform color space. 

7. A restricted color determination method in accordance 35 
with claim 4, wherein, in said step (b) for setting a ranking 
number, when said ranking numbers in said coordinate axis 
indicating said brightness component of said uniform color 
space are set so as to be different from said ranking numbers 

in said coordinate axes showing said chromaticity compo- 40 
nents of said color space, with respect to a distribution of 
each picture element in said image data in said uniform color 
space, dispersions in each coordinate axis direction of said 
uniform color space are determined, ratios of said disper- 
sions between each coordinate axis are determined, and in 45 
accordance with said ratios, a multiplying factor of said 
ranking numbers of said coordinate axis indicating bright- 
ness is determined with respect to said ranking numbers of 
said coordinate axes indicating chromaticity. 

8. A restricted color determination method in accordance 50 
with claim 7, which further comprises the steps of: 

reading least significant bits of digital data expressing 
values of three primary colors of each said picture 
element of said image data, wherein the three primary 
colors are red, green and blue; 55 

determining a periodicity at which identical values are 
exhibited in said least significant bits of picture ele- 
ments disposed in a connected manner in said image 
data; 

determining weighting coefficients based on periodicity 
data; and 

revising said histogram by weighting by means of said 

weighting coefficients, 
and wherein the steps described above are performed 65 

prior to step (b) utilizing a discriminant analysis with 

respect to said histogram. 
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9. A restricted color determination method in accordance 
with claim 7 wherein, with respect to said approximated 
image data approximated by means of representative colors 
in said step (e), said steps (a), (b), (c), (d), and (e) are 
repeatedly performed in order, thereby said representative 
colors are further reduced. 

10. A restricted color determination method in accordance 
with claim 9 which further comprises the steps of: 

reading least significant bits of digital data expressing 
values of three primary colors of each said picture 
element of said image data, wherein the three primary 
colors are red, green and blue; 

determining a periodicity at which identical values are 
exhibited in said least significant bits of picture ele- 
ments disposed in a connected manner in said image 
data; 

determining weighting coefficients based on said period- 
icity data; and 

revising said histogram by weighting by means of this 
weighting coefficient prior to said step (d). 

11. An apparatus for determining restricted color, com- 
prising 

data extraction means for extracting least significant bits 
of digital data expressing values of three primary colors 
of each picture element of image data, wherein the 
three primary colors are red, green and blue; 

periodicity calculation means for determining a periodic- 
ity at which identical values appear in said subordinate 
bits in said picture elements disposed in a connected 
manner in an image; 

histogram calculation means for producing a histogram 
showing an appearance frequency of each color in a 
color image; 

histogram renewal means for conducting weighting revi- 
sion of said histogram based on periodicity data deter- 
mined by said periodicity calculation means; and 

representative color determination means for determining 
representative colors for the purpose of approximation 
of image data in terms of restricted colors by utilizing 
a discriminant analysis with respect to said histogram 
which was weighting revised by said histogram 
renewal mechanism 

12. An apparatus for determining restricted color com- 
prising: 

histogram calculation means for disposing each picture 
element of image data in a uniform color space, for 
setting ranking numbers in a coordinate axis indicating 
a brightness component in said uniform color space, for 
setting ranking numbers, different from the ranking 
number set in the coordinate axis indicating a bright- 
ness component, in each of coordinate axes indicating 
chromaticity components of said uniform color space, 
and determining a histogram of each of said picture 
elements of said image data in each coordinate axis; 
and 

representative color determination means for conducting 
a discriminant analysis with respect to said determined 
histograms and determining representative colors. 

13. An apparatus for determining restricted color in accor- 
dance with claim 12, further comprising emphasis coeffi- 
cient designation means for determining dispersions in each 
direction of the coordinate axis of said uniform color space 
for determining ratios of said dispersions between each 
coordinate axis, and for designating in accordance with said 
ratios a multiplying factor of ranking numbers of said 
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coordinate axis indicating brightness with respect to said 
ranking numbers of said coordinate axes indicating chroma- 
ticity, at the time of determination of a histogram by means 
of said histogram calculation means and with respect to a 
distribution of each picture element in said image data in 5 
said uniform color space. 

14. An apparatus for determining restricted color in accor- 
dance with claim 13, further comprising repetition control 
means for controlling said emphasis coefficient designation 
means, said histogram calculation means, and said repre- to 
sentative color determination means at the time of the 
display by means of a smaller number of representative 
colors of image data expressed in terms of representative 
colors determined by means of said representative color 
determination means, by means of repetition of the opera- 15 
lions of said emphasis coefficient designation means, said 
histogram calculation means, and said representative color 
determination means. 

15. An apparatus for determining restricted color in accor- 
dance with claim 13, comprising: 20 

periodicity calculation means for determining periodicity 
data indicating an appearance of identical values in 



subordinate bits with respect to digital data expressing 
three primary colors of said image data; and 
histogram renewal means for weighting revision of a 
histogram determined by means of said histogram 
calculation means, based on said periodicity data. 
16. An apparatus for determining restricted color in accor- 
dance with claim 15, further comprising repetition control 
means for controlling said emphasis coefficient designation 
means, said histogram calculation means, said periodicity 
calculation means, said histogram renewal means, and said 
representative color determination means at the time of the 
display by means of a smaller number of representative 
colors of image data expressed in terms of representative 
colors determined by means of said representative color 
determination means, by means of repetition of the opera- 
tions of said emphasis coefficient designation means, said 
histogram calculation means, said periodicity calculation 
means, said histogram renewal means, and said representa- 
tive color determination means. 
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